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1 Introduction 

Let P denote a Dirichlet random probability measure on a Polish space 3^, with law denoted as 
'D{dP\6H), where 6* is a non-negative scalar and if is a (fixed) probability measure on y. In addi- 
tion let M. denote the space of boundedly finite measures on y. This space contains the space of 
probability measures on y. The Dirichlet process was first made popular in Bayesian nonparametrics 
by Ferguson (1973), see also Freedman (1963) for an early treatment, and has subsequently been used 
in numerous statistical applications. Additionally, the Dirichlet process arises in a variety of interest- 
ing contexts outside of statistics. Formally, P is said to be a Dirichlet process if and only if for each 
finite collection of disjoint measureable sets . . . , A^;, the random vector P{Ai), . . . , P{A)^) has a 
Dirichlet distribution with parameters 9H{Ai), . . . ,6H{Ak). In particular P{A) is a beta random 
variable for any measurable set A. An important representation of the Dirichlet, which is analogous 
to Lukacs characterization of the gamma distribution, is 

(1) 

where /i is a gamma process with finite shape parameter 9H and T — Jy l^{dy) is a gamma random 
variable with shape 9 and scale 1. The law of the gamma process is denoted as Q{d^\9H), and is 
characterized by its Laplace functional 

(2) / e-^(^')^(d/i|0iI) = e"/3.'°^''+^^^^l'''^'"^ 



IM 

for g a positive measurable function satisfying. 



(3) / log[l+giy)]9Hidy)<oo. 

Jy 

We note that if H is non-atomic then the gamma process may be represented as 

/>oo 

(4) ^l{dy) - / sN{ds,dy) 



where iV is a Poisson random measure with mean intensity, 

9s-h-'dsHidy). 

An important fact is that T and P are independent, which as we shall see, has a variety of implica- 
tions. 

An interesting and formidable problem initiated in a series of papers by Cifarelli and Regazz- 
ini(1990) is the study of the exact distribution of linear functionals. 

Pig) = / 9{y)P{dy) 
Jy 

of the Dirichlet process. Diaconis and Kemperman (1996) discuss an important by-product of this 
work called the Markov-Krein identity for means of Dirichlet processes, 

1 - J loell+zg(y)]0H(dy) 



(5) / -—gV{dP\9H)=e-Jy 

Jm (1 + zP{g)y 

which has implications relative to the Markov moment problem, continued fractions theory, ex- 
ponential representations of analytic functions, etc [see Kerov (1998) and Tsilevich, Vershik and 
Yor (2001a)]. Tsilevich, Vershik and Yor (2001a) expand upon this emphasizing that the right hand 
side of lO is the Laplace functional of a Gamma process with shape 9H. That is, 

(6) / l^V{dP\9H) = / e-^^^<^^g{df,\9H) 

Jm {l + zP{g)) Jm 
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Their interpretation of the Markov-Krein identity is that the generahzed Cauchy-Stieltjes transform, 
of order 9, of P{g), where P is a Dirichlet process with shape OH, is the Laplace transform of 
when /i is the gamma process with shape 9H. The authors then exploit this fact to rederive © via 
an elementary proof using the independence property of P and T. An interesting question, is what 
can one say about 

(7) / —-^—-gVidP\9H) 

when 9 and q are arbitrary positive numbers? That is, can one establish a relationship of iQ to the 
Laplace functional of some random measure say //*, which is similar to ^, for all q and 9. Lijoi and 
Regazzini (2003) establish analytic results for {Tj), relating them to the Lauricella theory of multiple 
hypergeometric functions. Theorem 5.2 of their work gives analogues of ©, stating what they call 
a Lauricella identity, but does not specifically state a relationship such as We should say for 
the case 9 > q that it would not be terribly difficult to deduce an analogue of (0) from their result. 
However, this is not the case when 9 < q, which is expressed in terms of contour integrals. Their 
representations, for all 9 and q, as clearly demonstrated by the authors, however have practical 
utility in regards to formulae for the density of P{g)- In this case, one wants to have an expression 
for O, when q = 1 and for all 9. Related works include the papers of Regazinni, Guglielmi and di 
Nunno (2002), Regazzini, Lijoi and Pruenster (2003) and the manuscript of James (2002). 



1.1 Preliminaries and outline 

In this paper we develop results that are complementary to the work of Lijoi and Regazzini (2003) 
and Tsilevich, Vershik and Yor (2001a). In particular, we show that the Markov-Krein identity, as 
interpreted in Tsilevich, Verhsik and Yor (2001a), extends to a relationship between {Tj) and the 
Laplace functional of a class of what we call beta-gamma processes defined by scaling the gamma 
process law by T~'^^~'^\ for all positive 9 and q. That is processes with laws equal to 

(8) BG{dfi\9H, 9-q) = £|^T-(»-9)0(d^|0if) 

Perhaps more interesting, is the method of approach, and derivation of supporting results, used 
to establishing such a result, which is quite different than the analytic techniques used previously. 
The approach relies in part on, in this case mostly familar, Bayesian prior posterior calculus for 
Dirichlet and gamma processes in conjunction with the usage of the following well-known gamma 
identity for g > 

That is to say, purely analtyic arguments are replaced by probabilistic ones using the familiar 
results in Ferguson (1973), Lo (1984) and Antoniak (1974). Thus giving the derivations a much 
more interpretable Bayesian flavor. More specifically, albeit less well known, we use the results 
in Lo and Weng (1989) as demonstrated for more general proceses in James (2002, 2003). This 
bypasses the need for instance to verify certain integrability conditions and the usage of limiting 
arguments. Moreover, somewhat conversely to Lijoi and Regazinni (2003), we show how properties 
of the Dirichlet and beta-gamma processes yields easily interesting identities related to Lauricella 
and Liouville integrals[see Lijoi and Regazinni (2003) and Gupta and Richards (2001)]. Although we 
exploit the independence property of T and P to prove our results, our approach is quite different 
from the methods used by Tsilevich, Verhsik and Yor (2001) to prove ©. While their proof is 
certainly elegant, it does not seem possible to extend to other processes. Our methods however are 
influenced by their proof of an analogous result for the two-parameter extension of the Dirichlet 
process which relies on ^ and the fact that such processes are based on scaled laws. That is to say 
we present an approach which is extendable to other models[see James (2002, section 6)]. 
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The study of scaled laws are of clear interest in the case of the stable law of index < a < 1 
as discussed in Pitman and Yor (1997) [see also Pitman (2002)]. In particular the two-parameter 
(a, 0) extension of the Dirichlet process[see Pitman (1996)] can be defined as P in (^) which has law 
governed by T~^V{dij\pa, H), where V{diJ,\pa, H) is the law of the stable law process, which can be 
derived from a Poisson random measure with intensity, 

Pc{ds)H{dx) ^ s-°'-^dsH{dx). 

However, for the beta-gamma processes defined in the independence property between T and P 
translates into the following property 

(10) / f{P)V{dP\9H)^ f f{P)g{dfi\9H)^ [ f{P)Bg{dn\eH,0~q). 

JM JM JM 

for all integrable /. The property H10|l seems to suggest that the beta-gamma process may not have 
much utility relative to calculations involving P, however it is precisely this property that we shall 
exploit. The outline of this paper is as follows; in section 2 we revisit well-known properties of the 
Dirichlet process P and describe the posterior distribution of p given Y = {Yi, . . . , 1^} when Y\P 
is an iid sample from P. In particular, we show that the posterior distribution of p\Y is a posterior 
beta-gamma process, and derive its Laplace functional. In section 3 we present a general analysis of 
the properties of the beta-gamma process including a description of its posterior distribution which 
is shown to be a conjugate family. Additionally formulae for the Laplace functional are derived and 
some key results which are relevant to the proof of the Markov-Krein identity are given. In sections 
4 and 5 we present results that describes formally the various relationships between Q and the 
beta-gamma processes. 



2 Some results for the Dirichlet and Gamma process 

We first recall some key features of the gamma and Dirichlet processes. Hereafter, we will assume 
that H is non-atomic, and that each function g satisfies Let Yi, . . . , y„ denote random elements 
in the space y, which conditional on P are iid with law P. P is a Dirichlet process with shape 
9H. From Lo and Weng (1989) [see also James (2002, 2003)], one has the following disintegration of 
measures, 

n n n(p) 

(11) \lp{dY,)g{dp\eH)^g{dp\eH + Y,^Y^W'^''^ H ^^<^3,n)H{dY*), 

i=l 8=1 j = l 

where g{dp\9H + ^Yi) denotes a gamma process with shape 9H + J27=i ^Yi- The quanitity 

p = {Ci, . . . , C„(p)} denotes a partition of the integers {1, . . . , n}, with n{p) elements. The Cj = 
{i : Yi = Y*} for j — l,...,n(p) denote the collection of values equal to each unique Y*, for 
j = 1,. . . ,n(p). The size of each cell Cj is denoted as ej^n- Recall that a gamma process can also 
be described as in in terms of a Poisson random measure with mean intensity Q. Another 
important property of the Gamma process is the following exponential change of measure formula, 

(12) e-^'^s^g{d^l\9H) = g{dp\p,+g,9H)e- U ^°di+siy)]eHidy) 

where g{dp\pi-^-g,9H) denotes a weighted gamma process defined for each Borel measurable set A 
as, 

(13) / [l+.9(y)]-V(d2/) 

JA 

or equivalently by its inhomogeneous Levy measure pi+g{ds\y) = c^'^+^'^-'^^s^^ds. 
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REMARK 1. The result (IT^ appears in Lo and Weng (1989, Proposition 3.1) and has been 
independently derived in Tsilevich, Vershik and Yor (2001b). Versions of this result also hold for the 
case where g is negative or complex valued. For this study, we can actually bypass the explicit usage 
of H12I) but use it to demonstrate how one might apply a similar result for more general random 
processes as in James (2002). In particular, we note that this operation is useful for the stable law, 
which does not admit a result similar to 111(1 

As an illustration, similar to Lo and Weng (1989, Corollary 3.1), we show how one uses (|11() 
to obtain the classic results for the Dirichlet process via its representation as a normalized gamma 
process. In particular, we show how one easily estabishes the disintegration, 

n n n(p) 

(14) Y[P{dYi)V{dP\9H) ^V{dP\eH + J2SYj7r{p\e) [| H{dY*), 

i=l j=l j=l 

where V{dP\9H + ^Yi) is a Dirichlet process with shape OH + X]j=i ^Yi: and is the posterior 

distribution of P|Y [see Ferguson (1973)]. The partition probability 

is a variant of Ewens sampling formula derived by Ewens (1972) and Antoniak (1974). The marginal 
distribution of {Yi, ... ,1^} is the Blackwell-MacQueen Polya urn distribution which can be repre- 
sented as 

n(p) 

(15) W{dY\eH) = 7r(p|(?) n H{dY*). 

The result in H14|l can be obtained by working with the joint probability measure of Y and /i given by 
replacing 'D{dP\6H) on the left hand side of H14I) with the gamma process law, Q{dfj,\6H). The task 
then shifts to finding the disintegration of the law of {Y, fj,} in terms of the posterior distribution 
of /i|Y and the marginal distribition of Y. An application of (|ll|l shows that the joint distribution 
of {Y,/i} has the following disintegrations, 

n n "(p) 

(16) T-'^'Y[fi{dYi)g{dfi\eH) ^T-"g{d^i\9H + J2^yW"^''^ 11 ^{ej,n)H{dY*). 

i—l i=l j=l 

First it is clear that the marginal distribution of Y is obtained by integrating out with respect 
to Gid^\6H + ^Yi)- Under this law, T is a gamma random variable with shape parameter 6 + n 
and unit scale. This implies that, 

/ T-"g(d^|0i/ + ^5yJ^^(^, 
Jm j-[ r(6' + n) 

yielding the desired expression for the marginal distribution of Y in H15|l . Now in order to obtain 
the posterior distribution of P given Y, first notice that the posterior distribution of /i given Y 
is obtained by dividing by the marginal distribution of Y. That is, we see that its posterior 
distribtion is of the form in (jSJ with specific law 

(17) Bg{dfi\9H + J2SY,n)^ ^^^^^T-"g{dfi\0H + <SyJ 
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It is not immediately obvious that the posterior distribution of /i|Y in H17() indicates that the 
posterior distribution P\Y is 'DidPlOH +^^^^ However, note that subject to the gamma process 
law Q{dii\6H + Y^^=i ^Yi), P has the desired Dirichlet process distribution and is independent of T. 
Hence for any integrable /, using the independence of P and T, it follows from 11U|I that the 
posterior distribution of P given Y is characterized by 

n n Th n Til 

/ /(P)7r(dA*|Y) = / f{P)g{dii\eH + Y,^Y^)= f{P)V{dP\9H + Y,SyJ 

JM JM JM j^;^ 

for / arbitrary integrable functions, which yields the desired result. 



2.1 The posterior distribution of the gamma process 

While the posterior distribution of P given Y is well-known to be a Dirichlet process, the corre- 
sponding posterior distribution of /i given Y described is not a Gamma process. In fact it is no 
longer a Levy process. In order to understand what this distribution is we find it quite useful to 
employ the gamma identity (j^. In general, the gamma identity allows one to employ an exponential 
change of measure formula such as H12|) to handle terms like T~'^. For the present setting note that 
if T itself is a gamma random variable with shape parameter r and unit scale, then, 

E[e-^^] = {l + v)-\ 

Now if r — g > 0, Fubini's theorem yields, 

EIT-"] = ^ V-^l + v)-^dv - ' '^^ 



mJo r(T) 

This leads to the identification of a gamma-gamma density with parameters r and q denoted as, 

r(T) 

(18) j(dv\T,q) ^ , , \ ' -vi-^(l + v)-^dv for < i)< oo. 

r(g)r(T - q) 

Using the transformation u = 1/(1 + w) yields the density of a beta random variable with parameters 
T — q and q denoted as 

(19) B{du\T -q,q)^ ^. ^^^P n-^-l(l - uy-' for < < 1. 

r(g)r(r - q) 

In this section we will encounter the special case of t — 9 + n and q = n, yielding the densities 

^{dv\9 -\- n, n) and 

B{du\9,n) ^ Eii±I!lu^-i/i_u\n-^du for < m < 1 
r(n)r(6l) 

The gamma identity (O, (|12|) and Fubini's theorem yields the following explicit description of the 
posterior law of /u|Y, 

Proposition 2.1 Let fi denote a gamma process with law Q{d^\9H) and let P(-) = T~^ijl{-), where 
T — l^{y), denote a Dirichlet process with shape 9H . Suppose that Yi, . . . ,Yn\P are iid P, then the 
posterior distribution o/ /x|Y is BQ{d^\9H + ^^^^6Yi,n) as defined in Jj7| ). Its Laplace functional 
is expressible as 

(20) r e-L Yl (1 + j^giY;)r'\idv\9 + n, n) 
Jo fj[ 1 + w 
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The Laplace functional can also be represented in terms of a beta density as, 

(21) / e- Jy '°^^^+"siy)]eHidy) -q ^ ug{Y*))-''-"Bidu\9, n) 

■Jo 

The Laplace functional in ^21}) shows that the posterior distribution of /i|Y is equivalent to the 
distribution of the random measure UnG^, where Un is a beta random variable with parameters 
{6, n) and independent of Un, G* is a gamma process with shape OH + J2^=i ^Yi ■ As shown by h2U\) . 
Un = 1/(1 + Vn), where Vn is a gamma-gamma random variable with parameters (9 + n,n). 



Proof. First using one can write 

(22) r{n) e-'^(f)r-"g(d^|6li7 + VjyJ = / e-''(f)e-''^a(rfA*|6'F + V <5yjd^; 

Jm Jo JM 

Recalling that the exponential change of measure p2fl transforms a gamma process to a weighted 
gamma process, two applications show that e~'^'^^^e~'"'^Q{d^\9H + X]"=i ^Yi) equivalent to, 

(23) g(dM|P[i+.+.],^i? + E^>'.)^"^-'""^^'^'^''''^''^ n (l + T^.9(^*)) ' (1 + ^^)^'+" 

1=1 j=i 

Now substituting the quantities depending on /i in the right hand side of H22II with (|23|) yields 
the first expression for the Laplace functional. The second expression is obtained by the change of 
variable u= 1/(1 + w) □ 

We can now use the explicit description of the posterior distribution of /i|Y to deduce the 
posterior distribution of P|Y. Note that subject to the posterior law of /i|Y, the posterior distribution 
of P| Y must be equivalent to the law of the process 

p*/ \ UnGnj-) _ Gn{-) 
UnG*n[y) ~ G*m 

which shows, as desired, that P* is a Dirichlet process with shape aH + X]"=i ■ 

REMARK 2. Although stated a bit differently. Proposition 2.1 is equivalent to Proposition 5.7 
of James (2002). 



3 Properties of Beta-Gamma processes 

As seen, the posterior distribution of /i|Y is a special case of a class of mixed gamma processes 
defined by a scaling operation in ((HJ and called beta-gamma processes. For shorthand, we say that 
/i is BQ{9H,9 — q), to indicate that fi has a beta-gamma law defined by BQ{dij\0H,9 — q). When 
9 — q — 0, the process reduces to a gamma process with shape 9H . Similar to the proof of Proposition 
2.1, in the case that 9 — q> Q, one may use and (|12|l to obtain the Laplace functional given by 
the following proposition. 

Proposition 3.1 Let fi denote a beta-gamma process with law BQ{dfi\9H, 9 — q) such that 9 — q > 
then the Laplace functional is given by 

(24) / e-^^^^^Bg{di,\9H, 9 - q) = f e' L B{du\q, 9~q). 

JM JO 

Using the transformation v — u/{\ ~ u) the Laplace functional can also be written in terms of a 
gamma-gamma density with parameters {9 ~ q,9). 
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Next we describe the posterior distribution of the general class of beta-gamma processes. 

Proposition 3.2 Let /i denote a beta-gamma process with law BQ{d^\9H,9 — q) and let P(-) = 
T^^/i(-), where T = /i(3^), denote a Dirichlet process with shape OH . Suppose that Yi, . . . , Yn\P are 
iid P, then the posterior distribution of /i|Y is BQ{OH + Yll^=i Svijd + n — q), defined by the law 

(25) BGiOH + Y,^Y,,0 + n-q) = ^^^l±^T-^'^+^~'''>g{dfi\eH + -^rj 

1=1 i=i 

If + n — q > 0, then the Laplace functional of the posterior distribution is 



(26) e- '°'^^'+-siy)]OHidy) ^ ug{Y*)r^-B{du\q, O + n-q). 



Proof. Note that the marginal distribution of Y is the Blackwell-MacQueen urn distribution. 
The posterior distribution can be obtained easily by following the arguments for the case of the 
gamma process. In particular one can work with in place of T~" in IjlSfl and adjust for 

normalizing constants, li 9 + n — q > 0, then the Laplace functional is obtained by using the proof 
of Proposition 2.1 with r(n) and v"^^ in (|22|l replaced by T{d + n — q) and yS+^-<i-^_ □ 

Using standard Bayesian arguments, we obtain an identity for the Laplace functional of a gamma 
process, and also an expression of the Laplace functional for all beta-gamma proceses. 

Proposition 3.3 Let ^ be a beta- gamma process, BQ{0H,9 — q) then choosing an integer n > such 
that 9 + n — q > 0, the Laplace functional, Jj^ e^^^^^BQ{dii\9H, 9 — q), can be expressed as follows. 



JO 



- j log[l+ug(v)]eH{dy) 



"(P) ^ 

n / {l + ug{y)r--H{dy) 

j=i Jy 



B{du\q, 9 + n — q) 



for all positive 9 and q. Using a change of variable v = u/{l — u) leads to an expression in terms of 
a gamma-gamma density. 

Proof. The proof follows from standard Bayesian theory and the expression in (|26|) . That 
is, the Laplace functional can be obtained by integrating the Laplace functional of the posterior 
distribution described in with respect the Blackwell-MacQueen distribution as follows, 



(27) 



Jy" [Jm 



W{dY\9H) 



□ 



We close this section with another interesting result which will be used in the coming section. 

Proposition 3.4 Let 9, q be arbitrary non-negative scalars. Then for any integer n > that satisfies 
the constraint, 9 -\- n ~ q > the following formula holds. 



(28) 



1 



'm {t + Kg)) 



i=l 



T{9 + n~q) 



P n 

/ e-'''^s)T-io+"-i)g{dfi\9H + y^SY, 
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The expressions are equivalent to 

(29) ^itt^^ f e-'^(^)Bg{df,\9H + J2SY.,9 + n-q), 

r(6' + n) Jm j-l 



whose explicit expression is deduced from \2tl\) . 

Proof. From H29|l and (|26|l . the proof proceeds by showing that, 

(30) mr:^^J ,t^\ .., Q{dn\eH + j25y^ 



is equivalent to H2t)|l . Apply the gamma identity to {T + ^{g)) and then two applications of (|12|) 
to e-''[^(9)+^le(d/^|6ii/ + ^"^^ 5y,) to show that ^ is equal to, 



T{6 + n-q)T{q) 



poo c ■"vt-y _ 

Jo fJi il + vf'^" 



The result is obtained by applying the transformation u = v/{l + v). O 

4 Functionals of Dirichlet processes, The Markov-Krein Iden- 
tity and Beta-Gamma processes 

Here we show that results relating O to the beta-gamma process can be deduced from ©, ((T^ 
and the the posterior distribution of fi. A general strategy is formed by first writing 

1 T 



l + zPig) T + z^i{g) 

Before proceeding to the main result we illustrate the idea for the special case of 6* — q > 0. First 
write, 

(31) / n \( ... T^idPrn = f J\ ... GidfiieH) 
Jm (1 + zP{g)r Jm [T + zn{g)Y 

Note the presence of T'^ causes some difficulties. However when 6* — g > we can use directly the 
special relationship between the Dirichlet process and the beta-gamma processes exhibited in (jlOII . 
That is replacing g{dfj.\eH) with Bg{d^i\eH,q) in (ETJ yields, 

(32) / n ^ \i v{dP\eH) = / ^ ..M Mm 
Jm (1 + zP{g)r r(6' - 9) Jm (1 + znig)) 

At this point one can evaluate the expression H32f) using @. However a direct appeal to Propo- 
sition 3.4 with n = shows that 

/ ^^^ '^(dP\eH)^^ [ e-''(^)r-(«-'')g(d^|0i7) = / e-^(^^B{df,\eH,e-q) 

Jm (1 + zP(g)r r(g) Jm Jm 

The case where q is arbitrary requires another strategy that involves and the posterior 
distribution of /i|Y. Using these arguments we present a new result which relates the generalized 
Cauchy-Stieltjes transform of Dirichlet process linear functionals to the Laplace functional of beta- 
gamma processess. This presents a generalization of the Markov-Krein identity, complementary to 
the Lauricella identities deduced in Lijoi and Regazzini (2003, Theorem 5.2). We also present some 
interesting additional identities. 
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Theorem 4.1 Let 'D{dP\9H) denote a Dirichlet process with shape 6H. Let g denote a function 
satisfying 0), then the following relationships are established, 

(i) for any positive q and 9, 



(33) 



/ {l + zP{g)yV{dP\eH)^ [ e-"'^^'^Bg{dfi\9H,e - q) 
Jm Jm 



Statement (i) implies the following results. 

(ii) For any positive q and 6, and any integer n > which satisfies 9 + n — q > 0, the quantities 
in i^Sf-jp are equivalent to, 



c "(p) I- 

Y^n{p\9) ,-//o«[i+«.to)l«^('^.) l[hl + ugiy)n-H{dy) 
p ^0 ^.^1 Jy 



B{du\q, 9 + n — q), 



for the gamma process, its Laplace functional may be represented as above for all n > 1 and 
q = 9. 

(Hi) When, 9 — q > statement (i) combined with Lemma 3.1 imply that 



(34) 



(I + zP{g)yV{dP\9H) 



M 



which coincides with the result in Lijoi and Regazzini (2003, Theorem 5, equation (5.2)). 



Proof. For the proof of statement (i), we first assume without loss of generality that q = n+d, 
where d is a positive scalar such that 9~d > 0, and n > is an integer chosen such that 9 + n~q > 0. 
This means that r« = T"+''. Now using lO with Bg{dn\9H,d) yields the expression, 



(35) 



{I + zP{g)y'^V{dP\9H) = 



jg{dn\9H). 



M 



Now to handle the term T", write it as T" 
expressions in (|35|l are equal to, 

T{9 + n) r \ r 1 



m 

nO-d)jM {T + z^,[g)f'- 
/v" nr=i /^('^^O) then apply Hll() to show that the 



V(9 - d) 



y^ 



n 



M iT + zn{g)y 



rg{dn\9H + J2SY,) 



Apply Proposition 3.4 to the inner term, recalling that 9 
expression as in H27() . □ 



1=1 
n — q 



]PidY\9H) 

' — d. This yields the desired 



We now discuss some interesting results obtained from Theorem 4.1. Let C{Z) denote the law 
of a random element Z. Recall that for a Dirichlet process functional, P{g), based on a Dirichlet 
process with shape 9H, one can represent its distribution as follows 

(36) £(P(.g)) = C{Ue,iP{g) + (1 - Ue,i)g{Y)) 

where P is T>{9H), Ug_i is a beta random variable with parameters {9, 1) and Y has distribution H. 
Additionally P,U,Y are independent. The right hand side of H3t)|l just follows from the fact that for 
fixed Y, it is the posterior distribution of P\Y based on n = 1 observation. Hence the unconditional 
distribution must be V{9H). That is, 

V{dP\9H) = I V{dP\9H + 5y)H{dy). 

Jy 
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See Diaconis and Freedman (1999) for an interesting usage of H36() . Here we point out some related 
results for /i. In particular, as pointed out in Lijoi and Regazzini (2003), for determining the density 
of functionals P{g), it is useful to have the expression for the Cauchy-Stietljes transform for the case 
q = 1. Theorem 4.1 shows that 

(37) / {l + zP{g)y^V{dP\eH)^ [ e-'^^s^BGidiiieH^e -1). 

JM JM 

Thus in principle one can use the right hand side of H37|l to perform an appropriate inversion to 
deduce the distribution of P{g)- See Lijoi and Regazzini (2003, Section 6) for details in that direction. 
Here, similar to the case of (|36|l we use the the explicit posterior analyis of n to characterize beta- 
gamma processes with shape OH and g = 1 for all 0. For the remainder of this work, let ^e,e-i be 
BQ{OH, 6* — 1), Ua.b denote a beta (a, b) random variable, let Tp denote a gamma random variable with 
shape p and scale 1, and let Yi be a random element with distribution H . Additionally, let /xg denote 
a gamma process with shape OH and assume that the variables ^e, Ua,b^Tp,Yi are independent. 
Additionally let Pq denote a Dirichlet process with shape OH. 

Proposition 4.1 Let /ie.e-i be BQ{OH, — 1) then for g a real valued function such that its absolute 
value satisfies 0), the following distributional equalities hold; 

(i) for allO>0 

(38) Ci^^e.e-l{g)) = CiUi^eMd) + Ui,eTig{Yi)) 
(a) for >l, 

C{Uis-iMg)) = £(C/i,eAie(<?) + Ui,eTig{Yi)) 
(Hi) For = \, /ii^o := /ii is a gamma process with shape H and 

C{^llig)) = £(C/i,iAii(.9) + Ui,iT,g{Yi)) 
(iv) If denotes a gamma process with arbitrary shape parameter OH then, 

(39) C{^lg{g)) = CiUe^iM + Ue^iT^giY^)) 

Proof. The proof is immediate from statement (ii) of Theorem 4.1 or Proposition 3.3. One 
may also use Proposition 2.1 and Proposition 3.1 to obtain statement (iv) and (ii). It is well-known 
that the condition Q is necessary and sufhcient for the existence of P{g). □ 

The equation H38() provides a simple description of the law associated with the right hand side 
of (|37|1 and should prove particularly useful in the case where < < 1. Notice that the only 
unknown quantity in (|38|l is the distribution of neig)- This suggests that in principle one can con- 
centrate on the law of fJ,e{g) to ascertain the law of Pe{g) for all 6. Note this is not an obvious fact 
as one can use the representation 

(40) TePoig) ^ fioig). 

and the independence of Tg and Pe, to find easily the distribution of iig. However if one has the 
distribution of fJ-g^g) one has to negotiate the typically complex dependence structure of Tg and fig 
to obtain the law of Pg{g) 

One may use H37|l and H38|l to recover the expressions in Propositions 4 and 5 of Regazzini, 
Guglielmi and Di Nunno (2002) where Proposition 5 is a special case of the results in Regazzini, 
Lijoi and Pruenster (2003). The statement, H39(l provides a distributional identity for an arbitrary 
gamma process which we believe is new. One may verify (|37|l . by noting that H38|l satisfies. 



(41) 



£{fie,g^i{g)) = C{Ui,gfig{9) + Ui,gTig{Yi)) - C{TiPe{g)) 
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where Ti = Ui^gTg^i, with Ui,e and Tg+i independent, is independent of Pe{g), where Pg is T){9H). 
To see this, write 

Ui,e[fJ-o{9) + Tig(Yi)\ UifiTg+i 

-i-e+i 

and use the classic beta gamma calculus for random variables and the usual properties of Dirichlet, 
gamma processes. (|41|) combined with (|37|l yield the the obvious result, 

/ {\ + zP{g)y^V{dP\eH) = / e-''^^s)x)(^dP\9H)e-'dt 

J M Jo J M 

One may also use to prove Q and 10). 



5 What is a beta-gamma process? 

The final result which is a generalization of Proposition 4.1, is derived directly from Proposition 3.2 
and Proposition 3.3. This result explains what a beta-gamma process is and indeed implies Theorem 
4.1. 

Theorem 5.1 Let ^e^-q have distribution BQ{6H,9 — q) and let denote a gamma process with 
shape OH , then for all positive 9 and q and an integer n chosen such that 9 + n — q > , the following 
distributional equalities hold; 

(i) For all 9 and q > and an integer n chosen such that 9 + n — q > 0, 

"(p) 

(42) C{lJ,e^e-q) — ^{Uq,e+n-qtl'e + Ug^g+n-q ^ Gj^nSy*), 

where conditional on p the distinct variables on the right hand side are mutually independent 
such that, Uq,g-\-n-q *s bcta with parameters {q,9 + n — q), fig is a gamma process with shape 
9H , {Gj^n} are independent gamma random variables with shape Cj^n o,nd scale 1, and Y* for 
j — 1, . . . , n(p) are iid H . The distribution of p is 7r(p|0). 

(a) For 9 - q> 0, C{flgfi-q) = C{Uqfi^qfig) 

Statement (i) implies the following results. 

(Hi) For all positive 9 and q 

(43) Cifig^e-q) = C{TqPe) 

where Tq is a gamma random variable with shape q and scale 1 independent of Pg which is a 
Dirichlet process with shape 9H. 

(iv) For all positive 9 and q, C{Tgfig g_q) — C{Tqfi,g), where Tg is gamma with shape 9 and scale 1, 
independent offig g^q. Similarly Tq and fig are independent. 



Proof. The distributional identity in (i) is a direct consequence of the mixture representation 
deduced from Proposition 3.2 which is deduced from the posterior distribution in Proposition 3.1. 
Note that all quantities on the right side of 142|l . including p, are random. Statement (ii) follows from 
Proposition 3.1. We now show that statement (iii) follows from statement (i). Notice that, Tg+n 
/^e(3^)+X]j=a'' Gj^m is a gamma random variable with shape 9-\-n independent of Uq^+n-q- Moreover 
using the mixture representation of the Dirichlet process derived from its posterior distribution and 
W{dY\9H), it follows that, 

Tg+n 
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is a Dirichlet process with shape 9H, independent of Tg+n and Uq^e+n-q- Hence the right hand side 
of can be written as, 

Uq.e+n-qTe+nPe 

The resuh is completed by noting that Uq^e+n~qTe+n is equal in distribution to Tq. Statement (iv) 
foUows immediately from (iii). □ 

The expression (|43|) tells us precisely that, for all 9 and g, a beta-gamma process with parameters 
OH and 9 — q is equivalent in distribution to a Dirichlet process with shape 9H ^ scaled by an 
independent gamma random variable with shape q. Hence, using this interpretation the first result 
in Theorem 4.1 is an immediate consequence of, 

e-*dt^ [ {1 + zP{g)y'^V{dP\9H). 

However, it is the other representations of the beta-gamma process that yield useful explicit expres- 
sions. 

6. Closing Remarks. The methodology discussed here relies on three main ingredients 
which are not specifically linked to the Dirichlet or Gamma process. That is, the use of a prior to 
posterior analysis of fi which manifests itself in terms of a scaled distribution, the use of a gamma 
identity and the use of an exponential change of measure. The rest relies of course on some specific 
features of the Dirichlet, gamma process calculus. James (2002, sections 5 and 6) demonstrates that 
using the three general techniques mentioned above, that is elements of what he calls a Poisson 
process partition calculus, that one can obtain a generalization of a Markov-Krein type relationship 
for all process P defined as in (Q) for all random measures ^ which are completely random measures 
or have laws based on a scaling of such processes. In so doing, he shows a natural duality between 
the posterior distribution of /i and P and the distribution of functionals of P. A key point is 
that the law of /z can always be represented in terms of a mixture representation derived from it 
posterior distribution. In principle, this serves to answer a question raised in Tsilevich, Vershik and 
Yor (2001a). We should say that in retrospect some of those results in James (2002, section 5 and 6) 
may seem a bit cryptic. The result in Theorem 4.1, without the explicit reference to a beta-gamma 
process are contained in Proposition 6.1 and Proposition 6.2 of James (2002, section 6). It is of 
interest to clarify and refine the results in James (2002, section 6) for more general P. In particular, 
we believe it would be useful to combine these ideas with the related results of Regazzini, Lijoi and 
Pruenster (2003). 
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